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DETAILED ACTION 

1 . This action is responsive to the remarks filed on 1/12/2006. 
This action is made Final. 

2. In the amendment, claims 17-20 have been added. Claims 1-20 are pending in the case. 
Claims 1, and 8 are independent claims. 

Drawings 

3. The drawings filed on 10/19/2001 have been approved by the examiner. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (I) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

5. Claims 1-6, 8-13 remain, and 17-18 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Ma et al, hereinafter Ma (Pat.# 5,909,805 B2, 6/21/2005, filed on 1/31/2001). 
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Regarding independent claim 1, Ma discloses scanning a document containing printed 
text, and handwritten annotations — capturing an original image of a document - (col. 3, lines 
57-62, fig.l). 

Moreover, Ma discloses separating annotations from printed text, and the detection of the 
handwritten annotations in the document — detecting the annotations which were made to the 
document before or prior to capture — (col. 4, lines 3-11, fig.l). 

Furthermore, Ma discloses the saving of the extracted handwritten annotations into 
memory — generating a summary of a document by extracting portions of the image document 
identified by the detected annotations, the summary including only the extracted portions of the 
document and being generated as a separate electronic image document that is different from the 
original image - (col. 7, lines 52-61, fig.7-8). 

Regarding claim 2, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into memory — generate a summary of the 
same document as that on which the annotations are detected — (col. 7, Hnes 52-61, fig.7-8). 

Regarding claim 3, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory — generate 
a summary of a different document as that on which the annotations are detected — (col. 7, lines 
52-61, fig.7-8). 
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Regarding claim 4, which depends on claim 1, Ma discloses the storage of extracted text 
from the scanned document, which contains the handwritten annotations, to serve as an original 
document — capture an image of a second document to be summarized based on detected 
annotations from a first document (col. 8, Hnes 1-30, 48-67, col. 14, lines 16-45, fig.l, 4). 

Regarding claim 5, which depends on claim 1, Ma discloses the generation of a region of 
bounding boxes, in the scanned document, used for extracting the handwritten annotations — 
image region associated with a detected annotation - (col. 3, lines 57-col.4, line 11, fig.l, 3 A- 
B). 

Regarding claim 6, which depends on claim 5, Ma discloses the generation of a region of 
bounding boxes of sentences for which the annotations have been written, in the scanned 
document, and which are used for extracting the handwritten annotations — image region 
associated with a detected annotation, the image region represents a sentence in the document 
image to provide context for the identified annotation ~ (col. 3, lines 57-col.4, line 11, fig.l, 3 A- 
B). 

Claims 8-13 are directed towards a method for implementing the system found in claims 
1-6 respectively, and therefore are similarly rejected. 

Regarding claim 17, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten aimotations from the scanned document, into memory— extracting image maps of 
the original image of the document, (col. 7, lines 52-61, fig.7-8). 
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Claim 18 is directed towards a method for implementing the steps found in claim 8, and 
therefore is similarly rejected. 

Claim Rejections - 35 USC §103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to 
a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

7. Claims 7, and 14-16 remain rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ma, in view of Kurosawa et al, hereinafter Kurosawa (Pat. # 6,751,779 Bl, 6/15/04, filed on 
3/20/2000). 

Regarding claim 7, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory (col. 7, 
lines 52-61, fig.7-8). Ma fails to explicitly disclose: a summary comprising portions which are 
selectively expandable to increase the information in that portion of the summary. However, 
Kurosawa teaches the inserting a series of characters located in document lines into a document 
(col.6, lines 40-67). It would have been obvious to a person of ordinary skill in the art at the time 
of the invention to combined Ma, and Kurosawa, because Kurosawa teaches the reducing of 
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burdens put upon an editor of a document, by using simple operations (col. 1, lines 59-67, and 
col.2, lines 28-53). 

Claim 14 is directed towards a method for implementing the system found in claim 7, and 
therefore is similarly rejected. 

Regarding claim 15, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory (col. 7, 
lines 52-61, fig.7-8). Ma fails to explicitly disclose: the summary includes expandable detail 
levels. However, Kurosawa teaches the inserting a series of characters located in document lines 
into a document, either by going over, or staying within a certain range — expandable detail 
levels (coL6, lines 40-67). It would have been obvious to a person of ordinary skill in the art at 
the time of the invention to combined Ma, and Kurosawa, because Kurosawa teaches the 
reducing of burdens put upon an editor of a document, by using simple operations (col. 1, lines 
59-67, and col.2, lines 28-53). 

Claim 16 is directed towards a method for implementing the apparatus found in claim 15, 
and therefore is similarly rejected. 



8. Claims 19-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ma, in view 
of Lemer et al, hereinafter Lemer (Pat.# 6,859,909, 2/22/2005, filed on 3/7/2000). 
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Regarding claim 19, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory (col. 7, 
lines 52-61, fig.7-8). Ma fails to expUcitly disclose: the summary includes at least one of a 
pointer and address indicating a place in the original image of the document from which the 
extracted portions are extracted. However, Lemer that the storing a list of x and y coordinates 
of the locations where the user draws the annotations (col 15, lines 27-67), It would have been 
obvious to a person of ordinary skill in the art at the time of the invention to combined Ma, and 
Lemer, for all the reasons listed by Lemer including the effective integration of text, ink, and 
highhghter to annotate web documents (col 1, lines 26-36), thereby making the web page easier 
to share the user's thoughts, and make it more interactive. 

Claim 20 is directed towards a method for implementing the apparatus found in claim 
19, and therefore is similarly rejected. 

Response to Arguments 
9. Applicant's arguments filed 1/12/2006 have been fiiUy considered but they are not 
persuasive. Regarding claims 1, and 18, Applicants submit that Ma does not teach or suggest 
extracting portions of the document and generating a siunmary including only the extracted 
portion of the document, the summary being a separate image document different from the 
original image, as set forth in claims 1 and 8 (page 5). The Examiner disagrees. Ma teaches the 
extraction of annotations made to the margin of a document, and save all the annotations together 
on memory (col. 7, lines 52-61, fig.7-8). In other words, a document containing all the 
annotations is saved on memory (fig. 8). 
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Moreover, Applicants also contend that Ma does not teach the detection of portions of the 
document identified by the annotations (page 6, parag.1-2). The Examiner disagrees, because Ma 
teaches the detection of the annotations placed on the margin of the document (col.4, lines 3-11, 
fig.7-8). In other words, areas in the margin of the document are identified, boxed in, and placed 
on a separate document. 

Regarding claims 15-16, the Applicants state that Kurosawa does not teach providing 
expandable detail levels (page 6, parag.3-5). The Examiner disagrees, since Kurosawa teaches 
the inserting a series of characters located in document lines into a document, either by going 
over, or staying within a certain range — expandable detail levels (col. 6, lines 40-67). In other 
words, the document lines are expanded by inserting additional data into the \mQS-4evels, 

Claims 2-7, and 9-16 depend fi-om claims 1, and 18, and therefore are rejected at least 
based on the same information above. 

Conclusion 

10. THIS ACTION IS MADE FINAL. AppHcant is reminded of the extension of 
time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory acfion is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event. 
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however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

I. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Cesar B. Paula whose telephone number is (571) 272-4128. The examiner 
can normally be reached on Monday through Friday from 8:00 a.m. to 4:00 p.m. (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong, can be reached on (571) 272-4124. However, in such a case, please 
allow at least one business day. 

Information regarding the status of an application may be obtained from the Patent 

Application Retrieval (PAIR) system. Status information for published applications may be 

obtained from either Private PAIR or Public PAIR. Status information for unpublished 

applications is available through Private PAIR only. For more information about the PAIR 

system, go to http://portal.uspto.gov/extemal/portal/pair . Should you have any questions about 

access to the Private PAIR system, please contact the Electronic Business Center (EBC) at 866 

217-9197 (toll-free). 

Any response to this Action should be mailed to: 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 
Or faxed to: 

• (571)-273-8300 (for all Formal communications intended for entry) 



CESAR FMULA 
PRIMARY EX^'^^INER 

3/21/06 



